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In the Claims; 

The following listing of claims will replace all prior versions and/or listings of claims in 
the application: 
Listing of Claims: 

1 . (Original) A method of implementing an intelligent video surveillance system, comprising: 

obtaining a frame sequence from an input video stream; 

executing a first-pass method for each frame of the frame sequence, the first-pass method 
comprising the steps of: 

aligning the frame with a scene model; and 
updating a background statistical model; and 
finalizing the background statistical model; 

executing a second-pass method for each frame of the frame sequence, the second-pass 
method comprising the steps of: 

labeling each region of the frame; and 

performing spatial/temporal filtering of the regions of the fi^me; 
identifying and classifying objects using the labeled and filtered regions; and 
analyzing behaviors of at least one of the objects. 

2. (Original) A computer-readable medium comprising software implementing the method of 
Claim 1. 
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3. (Original) An intelligent video surveillance system comprising a computer system 
comprising: 

a computer; and 

a computer-readable medium according to Claim 2. 

4. (Original) A method of implementing an intelligent video surveillance system, comprising: 

obtaining a frame sequence from a video stream; 

for each frame in the frame sequence, performing the following steps: 

aligning the frame with a scene model; 

building a backgroimd statistical model; 

labeling the regions of the frame; and 

performing spatial/temporal filtering; 
identifying and classifying objects based on the results of the labeling and filtering; and 
analyzing behaviors of at least one object. 

5. (Original) A computer-readable medium comprising software implementing the method of 
Claim 4. 

6. (Original) An intelligent video surveillance system comprising a computer system 
comprising: 
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a computer; and 



a computer-readable medium according to Claim 5. 



7. (Original) A method of implementing an intelligent video surveillance system, comprising: 
obtaining a jframe sequence from a video stream; 
for each frame in the frame sequence, performing the following steps: 
aligning the frame with a scene model; 

building a backgroimd statistical model and a secondary statistical model; 

labeling the regions of the frame; and 

performing spatial/temporal filtering; 
identifying and classifying objects based on the results of the labeling and filtering; and 
analyzing behaviors of at least one object. 



8. (Original) A computer-readable medium comprising software implementing the method of 
Claim 7. 



9. (Original) An intelligent video surveillance system comprising a computer system 
comprising: 

a computer; and 

a computer-readable medium according to Claim 8. 
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10. (Original) A method of implementing an intelligent video sxirveillance system, comprising: 

segmenting video into foreground and background components, the segmenting 
comprising: 

obtaining a sequence of video frames; 

building and updating at least one background statistical model for each region of 
the video frames, based on the video frames; and 

assigning labels to the regions, based on the at least one background statistical 

model; 

identifying and classifying objects based on the labeled regions; and 
analyzing behaviors of at least one object. 

11. (Original) A computer-readable medium comprising software implementing the method of 
Claim 10. 

12. (Original) An intelligent video surveillance system comprising a computer system 
comprising: 

a computer; and 

a computer-readable medium according to Claim 11. 
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13. (New) The method of Claim 1, wherein said analyzing behaviors of at least one of the 
objects comprises: 

tracking at least one of the objects. 

14. (New) The method of Claim 1, further comprising: 

creating at least one rale to detect at least one specific activity; 

wherein said analyzing behaviors of at least one of the objects includes applying the at 
least one rale. 

15. (New) The method of Claim 14, wherein said at least one rule includes at least one 
virtual tripwire and determining when the at least one virtual tripwire is crossed. 

16. (New) The method of Claim 14, wherein said at least one rule includes a definition of at 
least one area and the determining at least one of when an object enters, when an object leaves, 
and when an object loiters in the at least one area. 

17. (New) The method of Claim 14, wherein said at least one rale includes at least one of 
determining when an object is added to a scene and determining when an object is removed firom 
a scene. 
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1 8. (New) A method of implementing an automated closed-circuit television (CCTV) 
surveillance system, comprising: 

providing CCTV equipment generating an input video stream; and 
implementing the method of Claim 1. 

19. (New) A method of implementing an automated security system, comprising the method 
of Claim 1. 

20. (New) A method of implementing an automated anti-terrorism system, comprising the 
method of Claim 1. 

21 . (New) A method of implementing an automated market research system, comprising the 
method of Claim 1. 

22. (New) The method of Claim 21, wherein said analyzing behaviors of at least one of the 
objects comprises: 

tracking behaviors of at least one of the objects in at least one retail location. 

23. (New) A method of implementing an automated traffic monitoring system, comprising 
the method of Claim 1. 
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24. (New) The method of Claim 23, wherein said analyzing behaviors of at least one of the 
objects comprises at least one of: 

detecting wrong-way traffic; 
detecting a broken-down vehicle; 
detecting an accident; and 
detecting a road blockage. 

25. (New) A method of implementing a video compression system comprising the method of 
Claim 1. 

26. (New) The method of Claim 4, wherein said analyzing behaviors of at least one of the 
objects comprises: 

tracking at least one of the objects. 

27. (New) The method of Claim 4, further comprising: 

creating at least one rule to detect at least one specific activity; 

wherein said analyzing behaviors of at least one of the objects includes applying the at 
least one rule. 
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28. (New) The method of Claim 27, wherein said at least one rule includes at least one 
virtual tripwire and determining when the at least one virtual tripwire is crossed. 

29. (New) The method of Claim 27, wherein said at least one rule includes a definition of at 
least one area and the determining at least one of when an object enters, when an object leaves, 
and when an object loiters in the at least one area. 

30. (New) The method of Claim 27, wherein said at least one rule includes at least one of 
determining when an object is added to a scene and determining when an object is removed firom 
a scene. 

3 1 . (New) A method of implementing an automated closed-circuit television (CCT V) 
surveillance system, comprising: 

providing CCTV equipment generating an input video stream; and 
implementing the method of Claim 4. 

32. (New) A method of implementing an automated secxuity system, comprising the method 
of Claim 4. 
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33. (New) A method of implementing an automated anti-terrorism system, comprising the 
method of Claim 4. 

34. (New) A method of implementing an automated market research system, comprising the 
method of Claim 4. 

35. (New) The method of Claim 34, wherein said analyzing behaviors of at least one of the 
objects comprises: 

tracking behaviors of at least one of the objects in at least one retail location. 

36. (New) A method of implementing an automated traffic monitoring system, comprising 
the method of Claim 4. 

37. (New) The method of Claim 36, wherein said analyzing behaviors of at least one of the 
objects comprises at least one of: 

detecting wrong-way traffic; 
detecting a broken-down vehicle; 
detecting an accident; and 
detecting a road blockage. 
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38. (New) A method of implementing a video compression system, comprising the method 
of Claim 4. 

39. (New) The method of Claim 7, wherein said analyzing behaviors of at least one of the 
objects comprises: 

tracking at least one of the objects. 

40. (New) The method of Claim 7, further comprising: 

creating at least one rule to detect at least one specific activity; 
wherein said analyzing behaviors of at least one of the objects includes applying the at 
least one rule. 

41 . (New) The method of Claim 40, wherein said at least one rule includes at least one 
virtual tripwire and determining when the at least one virtual tripwire is crossed. 

42. (New) The method of Claim 40, wherein said at least one rule includes a definition of at 
least one area and the determining at least one of when an object enters, when an object leaves, 
and when an object loiters in the at least one area. 
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43. (New) The method of Claim 40, wherein said at least one rule includes at least one of 
determining when an object is added to a scene and determining when an object is removed from 
a scene. 

44. (New) A method of implementing an automated closed-circuit television (CCTV) 
surveillance system, comprising: 

providing CCTV equipment generating an input video stream; and 
implementing the method of Claim 7. 

45. (New) A method of implementing an automated security system, comprising the method 
of Claim 7. 

46. (New) A method of implementing an automated anti-terrorism system, comprising the 
method of Claim 7. 

47. (New) A method of implementing an automated market research system, comprising the 
method of Claim 7. 

48. (New) The method of Claim 47, wherein said analyzing behaviors of at least one of the 
objects comprises: 
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tracking behaviors of at least one of the objects in at least one retail location. 

49. (New) A method of implementing an automated traffic monitoring system, comprising 
the method of Claim 7. 

50. (New) The method of Claim 49, wherein said analyzing behaviors of at least one of the 
objects comprises at least one of: 

detecting wrong- way traffic; 
detecting a broken-down vehicle; 
detecting an accident; and 
detecting a road blockage. 

5 1 . (New) A method of implementing a video compression system, comprising the method 
of Claim 7. 

52. (New) The method of Claim 10, wherein said analyzing behaviors of at least one of the 
objects comprises: 

tracking at least one of the objects. 

53. (New) The method of Claim 10, further comprising: 
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creating at least one rule to detect at least one specific activity; 
wherein said analyzing behaviors of at least one of the objects includes applying the at 
least one rule. 

54. (New) The method of Claim 53, wherein said at least one rule includes at least one 
virtual tripwire and determining when the at least one virtual tripwire is crossed. 

55. (New) The method of Claim 53, wherein said at least one rale includes a definition of at 
least one area and the determining at least one of when an object enters, when an object leaves, 
and when an object loiters in the at least one area. 

56. (New) The method of Claim 53, wherein said at least one rale includes at least one of 
determining when an object is added to a scene and determining when an object is removed fi-om 
a scene. 

57. (New) A method of implementing an automated closed-circuit television (CCTV) 
surveillance system, comprising: 

providing CCTV equipment generating an input video stream; and 
implementing the method of Claim 10. 
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58. (New) A method of implementing an automated security system, comprising the method 
of Claim 10. 

59. (New) A method of implementing an automated anti-terrorism system, comprising the 
method of Claim 10. 

60. (New) A method of implementing an automated market research system, comprising the 
method of Claim 10. 

61 . (New) The method of Claim 60, wherein said analyzing behaviors of at least one of the 
objects comprises: 

tracking behaviors of at least one of the objects in at least one retail location. 

62. (New) A method of implementing an automated traffic monitoring system, comprising 
the method of Claim 10. 

63. (New) The method of Claim 62, wherein said analyzing behaviors of at least one of the 
objects comprises at least one of: 

detecting wrong-way traffic; 
detecting a broken-down vehicle; 
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detecting an accident; and 
detecting a road blockage. 

64. (New) A method of implementing a video compression system, comprising the method 
of Claim 4. 
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